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ABSTRACT 

Six doctoral students evaluated an educational 
leadership program they were in by participating in a focus group 
simulation. The students were all enrolled in or auditing a 
qualitative research course at Northern Arizona University's Center 
for Excellence in Education (NAU/CEE) . Prior to the simulation 
participants were given instructions on the process of the group. 
Participants were to discuss the program's strengths, weaknesses, and 
make recommendations for improvement in admissions, program of 
studies, and the dissertation. The same three categories were also 
measured in a survey completed by all six respondents. The session 
met for about 1 hour and the students encoded the data from written 
transcripts. Recommendation results for doctoral program improvement 
addressed introduction to the program/admission process, class 
content, and preparation for dissertation/program support. Specif c 
recommendations included the following: improvement of the formal 
outreach component of the introduction and admissions process; clear 
itemized policies; informal portfolio review prior to the admissions 
process ; improvement in the sequence of classes ; greater flexibility 
of summer class offerings; limiting a faculty member's number of 
advisees; and clarifying the roles of college offices. Sample 
matrixes uses in the evaluation process are attached. (JB) 
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AN EVALUATION OF KEY COMPONENTS OF AN EDUCATIONAL 
DOCTORAL PROGRAM: Results of a Focus Group Teaching Simulation for 

Education Doctoral Students 

Introduction 

The purpose of this paper is to report the results of a focus group 
simulation with selected members of a doctoral qualitative research class at 
Northern Arizona University's Center for Excellence in Education (hereafter 
called N AU/ CEE) during the second summer session of 1993. 

The focus group methodology was chosen because of the qualitative 
nature of the research class (EDR 725). As pointed out by authors such as Krueger 
(1988), the focus group technique allows the educational researcher an 
opportunity to collect data which is reported from the client's point of view and 
contains a depth of detail not possible with quantitative methodology. 

Procedure 

The subjects for this focus-group simulation study consisted of 6 doctoral 
students in the Educational Leadership sub-speciality who were enrolled in EDR 
725 (Qualitative Research) or who were auditing the course during the second 
summer session of 1993. 

Prior to the actual focus-group session, the participants were given 
instructions about the proposed process of the group. The facilitator (another 
NAU/CEE doctoral student) informed the respondents that they would be 
discussing the Educational Leadership doctoral program in terms of perceived 
strengths, insufficiencies, and recommendations for improvement within three 
key areas The three general areas of the program to be discussed were 
admissions, program of studies, and the dissertation. 

In order to have a structure for presenting and analyzing data, a series of 
matrices (see blank matrices #1 - 4) were formulated with the same three 
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columns: strengths, weaknesses, and recommendations, The same three 
categories were also measured in a survey completed by all 6 respondents and a 
matrix was developed to present the survey results (see matrix #5). 

The actual focus-group simulation was conducted on July 15, 1993, with 
one of the doctoral students acting as facilitator and another doctoral student 
scripting and maintaining the taping equipment. The session lasted 
approximately one hour. Subsequently the students encoded the data derived 
from the session from written transcripts. 

Educational l eadership Doctoral Program : 
Perceived Strengths. WeaVr.^^ anri Recommendation* 

Data Analysis and Interpretation 

The data analysis /reporting procedures included : 
1 Ouster/ coding of the focus group data. 

2. Presentation of the demographic survey data in a profile sheet (see 
Demographic Profile). 

3. Graphic presentation of the open-ended survey data in a matrix (see Matrix # 
5). 

4 Graphic presentation of the focus group data in matrix format (see Matrices 1 - 
4). 

Conclusions 

Specific recommendations for doctoral program improvements were 
proposed in each of the three predetermined general areas. They are briefly 
outlined in the following section: 
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Introduction to the Program / Admissions Proem s 
Suggestions included the following: 

(1) Improved formal outreach; 

(2) California should be able to begin and finish classes in California; 

(3) Designation of an admissions advisor; 

(4) Gear, itemized policies; 

(5) Informal portfolio review prior to admissions process; 

(6) Interview guidelines for candidates to preview. 

Pass Content 

Recommendations in this area included: 

(1) Improved sequence of classes; 

(2) Increased flexibility of summer class offerings; 

Preparatio n for Dissertation / Program Support 

Suggestions to strengthen the program overall and the dissertation process 
specifically included: 

(1) Each faculty member in the department should have a limited number 
of advisees in order to increase accessibility; 

(2) The role of other offices on campus (i.e. the Graduate College and the 
Institutional Research Board) should be made clear earlier in the 
process; 

(3) Point out to applicants the program's emphasis on collaborative 
learning 

(4) Have uniform of departmental and university policy for all students. 
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Gender. Wales - 4 < 
Females - 2 ' 



Average Age: 39.83 
Range: 35 - 42 

Ethnicity: One African American 
Two Caucasians 
Three Mexican Americans 

Cities of Origin: One Sierra Vista, Arizona 
One San Diego, California 
Four Phoenix, Arizona 

Professional Positions: One Principal 

One Mid-level Manager 

Two Teachers 

Two Assistant Principals 



Average Years Experienced in Field: 13.1666 
Range: 7-19 Years 



Years Experienced in Present Position: 6.5 
Range: 4-13 Years 



Length of Time in Educational Leadership Program: 26 months 
Range: 12-36 months 



Expected Time of Graduation: One in 1993 

Five in 1994 
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EDR 725; Matrix #1 



INTRODUCTION TO THE DOCTORAL PROGRAM 






Strength* 


Weaknesses 


Recotn m eadations 


Services 








Reputation 








Convenience 
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EDR 725; Matrix #2 



ADMISSIONS PROCESS 








Strengths 


Weaknesses 


Recommendations 


Length of Time 








Portfolio 








Interview 
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EDR 725; Matrix #3 



CLASS CONTENT 








Strength* 


Weakness g§ 


Recomm endationt 


Aocettibdlity 








Quality 
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EDR 725; Matrix #4 



PREPARATION FOR DISSERTATION/PROGRAM SUPPORT 






Strengths 


Weaknetset 


Recommendation* 


Procedure* 








Program Culture 
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SURVEYS 










Strengths 


Weaknesses 


Recommendations 


Admissions 








Program of Stady 








Dissertation 
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